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Program description 



Everyday Mathematics, published by Wright Group/McGraw-Hill, 
is a core curriculum for students in kindergarten through grade 6 
covering numeration and order, operations, functions and se- 
quences, data and chance, algebra, geometry and spatial sense, 
measures and measurement, reference frames, and patterns. At 
each grade level, the Everyday Mathematics curriculum provides 
students with multiple opportunities to learn concepts and practice 



skills. Across grade levels, concepts are reviewed and extended in 
varying instructional contexts. The distinguishing features of Every- 
day Mathematics are its focus on real-life problem solving, student 
communication of mathematical thinking, and appropriate use of 
technology. This curriculum also emphasizes balancing different 
types of instruction, using various methods for skills practice, and 
fostering parent involvement in student learning. 



RSSCarch Four studies of Everyday Mathematics met the What Works attending schools in urban, suburban, and rural communities in 

Clearinghouse (WWC) evidence standards with reservations. multiple states.'' 

These studies included a total of approximately 12,600 students The WWC considers the extent of evidence for Everyday 
in grades 3-5 from a range of socioeconomic backgrounds and Mathematics to be moderate to large for math achievement. 



Effectiveness Everyday Mathematics was found to have potentially positive effects on students’ math achievement. 

Math achievement 

Rating of effectiveness Potentially positive effects 
Improvement index^ Average: +6 percentile points 

Range: -7 to +14 percentile points 



1. The evidence in this report is based on available research. Findings and conclusions may change as new research becomes available. 

2. These numbers show the average and the range of student-level improvement indices for all findings in three out of four studies that met the WWC stan- 
dards without reservations. The student-level improvement index for the fourth study could not be computed. 
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Developer and contact 

Developed by University of Chicago Schooi Mathematics Proj- 
ect. Published by Wright Group/McGraw-Hill. 220 East Dan- 
ieldaie Road, DeSoto, TX 75115. Web: www.wrightgroup.com. 
Teiephone: 800-648-2970. Fax: 800-593-4418. 

Scope of use 

Curricuium deveiopment for Everyday Mathematics began in 
1983. The developer reports that the curriculum is used in more 
than 175,000 classrooms by more than 2.8 million students. A 
second edition of the curriculum became available in 2001-02. 

Teaching 

Everyday Mathematics is structured differently for kindergarten 
than for grades 1-6. The kindergarten Everyday Mathematics 
curriculum is composed primarily of activities such as counting 
games, money exchanges, and puzzles. In grades 1-6, the cur- 
riculum is broken into units covering specific topics. The number 
of units per school year ranges from 9 to 12, depending on the 
specific grade and the topics covered. Each unit comprises 7 to 



14 individual lessons. The developer offers multiple professional 
development options, such as user conferences and institutes, 
onsite professional development programs, and online courses. 

Cost 

Curriculum sets are bundled by grade and are available for kin- 
dergarten through grade 6 (grade 6 is beyond the scope of this 
report). For kindergarten, the Core Teacher’s Resource Package 
costs $162.78 and includes Program Guide and Masters; Teach- 
er’s Guide to Activities; Teacher’s Reference Manual (grades 
K-3); Minute Math; Assessment Handbook; Home Connection 
Handbook (grades K-6); Number Grid Poster; Content-by-Strand 
Poster; and Mathematics at Home (books 1-3). For grades 1-5, 
the Core Teacher’s Resource Package costs $233.40 and in- 
cludes Teacher’s Lesson Guides (1 and 2); Teacher’s Reference 
Manual; Assessment Handbook; Home Connection Handbook 
(grades K-6); Math Masters; Minute Math+; Posters; Content-by- 
Strand; and one set of Student Materials (student math journals 
1 and 2). Supplemental materials and manipulatives are available 
separately and vary in price. 



Sixty-one studies reviewed by the WWC investigated the effects 
of Everyday Mathematics. Four studies (Carroll, 1998; Riordan & 
Noyce, 2001; Waite, 2000; and Woodward & Baxter, 1997) used 
quasi-experimental designs that met WWC standards with res- 
ervations. The remaining fifty-seven studies did not meet WWC 
evidence screens. 

The Carroll (1998) study included 76 fifth-grade students 
in four classrooms from four school districts using Everyday 
Mathematics and a comparison group of 91 fifth-grade students 
in four classrooms from similar districts, matched on student 
demographics and geographical location. The intervention group 
had used Everyday Mathematics since kindergarten. The com- 
parison group had used traditional basal mathematics texts at all 
previous grades. 

The Riordan and Noyce (2001) study included 3,781 fourth- 
grade students in 67 schools in Massachusetts using Everyday 



Everyday Mathematics 



Mathematics and a comparison group of 5,102 fourth-grade 
students in 78 similar schools, matched on baseline math achieve- 
ment scores and student demographics. Forty-eight schools in 
the intervention group had implemented Everyday Mathematics 
for four or more years (early implementers), and 19 schools had 
implemented Everyday Mathematics for two or three years (later 
implementers). The comparison group used 15 different textbook 
programs representing the instructional norm in Massachusetts, 
with the most commonly used programs being those published by 
Addison-Wesley, Houghton-Mifflin, and Scott-Foresman. 

The Waite (2000) study included 732 third-, fourth-, and fifth- 
grade students in six schools using Everyday Mathematics and 
a comparison group of 2,704 third-, fourth-, and fifth-grade stu- 
dents in 12 similar schools, matched on baseline math achieve- 
ment scores, student demographics, and geographical location. 
The schools in the intervention group were in their first year of 
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implementing Everyday Mathematics. The comparison group 
used a more traditional mathematics curriculum approved by the 
school district. 

The Wood\A/ard and Baxter (1997) study included 104 third- 
grade students in five classrooms in two schools using Everyday 
Mathematics and a comparison group of 101 third-grade 
students in four classrooms in one similar school, matched on 
student demographics and geographical location. The com- 
parison group used the Heath Mathematics curriculum, a more 
traditional mathematics program. 



Extent of evidence 

The WWC categorizes the extent of evidence in each domain as 
small or moderate to large (see the What Works Clearinghouse 
Extent of Evidence Categorization Scheme) . The extent of evi- 
dence takes into account the number of studies and the total 
sample size across the studies that met WWC evidence stan- 
dards with or without reservations.® 

The WWC considers the extent of evidence for Everyday 
Mathematics to be moderate to large for math achievement. 



Findings 

The WWC review of elementary school mathematics curricu- 
lum-based interventions addresses student outcomes in math 
achievement. 

The Carroll (1998) study reported a statistically significant 
positive effect of Everyday Mathematics on geometric knowl- 
edge. After accounting for pretest differences between Everyday 
Mathematics students and comparison students, the WWC 
determined that this finding was substantively important but not 
statistically significant. Based on this study finding, the WWC 
categorized the effect of Everyday Mathematics on geometric 
knowledge as being a substantively important positive effect.'* 

The Riordan and Noyce (2001) study reported a statistically 
significant positive effect of Everyday Mathematics on overall 
math achievement. Using school-level data provided by the 
authors, the WWC determined that this finding was statistically 
significant for the 48 early-implementing schools. For the 19 
later-implementing schools, however, the WWC determined the 
finding to be not statistically significant. Based on this study 
finding, the WWC categorized Everyday Mathematics as having 
a statistically significant positive effect on overall math achieve- 



ment for the 48 early-implementing schools and an Indetermi- 
nate effect for the 19 later-implementing schools. 

The Waite (2001) study reported a statistically significant 
positive effect of Everyday Mathematics on overall math achieve- 
ment. After accounting for the misalignment between the school 
as the unit of assignment and the student as the unit of analysis, 
the WWC determined that this finding was substantively impor- 
tant but not statistically significant. Based on this study finding, 
the WWC categorized the effect of Everyday Mathematics on 
overall math achievement as being a substantively important 
positive effect. The Waite study reported subtest results (con- 
cepts, operations, and problem solving). After WWC calcula- 
tions, these results were found to be positive but not statistically 
significant. The subtest analyses do not factor into the rating. 

The Woodward and Baxter (1997) study reported no signifi- 
cant effect of Everyday Mathematics on overall math achieve- 
ment. After accounting for pretest differences between Everyday 
Mathematics students and comparison students, the WWC 
confirmed this finding. Based on this study finding, the WWC 
categorized the effect of Everyday Mathematics on overall math 
achievement as indeterminate. The study also reported subtest 
results (computation, concepts, and problem solving) and found 



3. The Extent of Evidence categorization was deveioped to teii readers how much evidence was used to determine the intervention rating, focusing on the 
number and size of studies. Additionai factors associated with a reiated concept, externai vaiidity, such as students’ demographics and the types of set- 
tings in which studies took piace, are not taken into account for the categorization. 

4. The ievei of statisticai significance was caicuiated by the WWC and corrects for ciustering within ciassrooms or schoois and for muitiple comparisons. 
For an expianation see the WWC Tutoriai on Mismatch . See the Technicai Detaiis of WWC-Conducted Computations for the formulas the WWC used to 
calculate statistical significance. In the case of the Everyday Mathematics report, a correction for clustering was needed. 
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Effectiveness (continued) 



The WWC found Everyday 
Mathematics \o have 
potentially positive effects 
on math achievement 



References 



a statistically significant positive effect on the concepts subtest. 
WWC calculations revealed a substantively Important, but not 
statistically significant, positive effect for the concepts subtest 
and a substantively Important, but not statistically significant, 
negative effect for the computations subtest. The subtest analy- 
ses do not factor Into the rating. 

Four studies examined outcomes in math achievement: One 
study (Riordan & Noyce, 2001, 48 early-implementing schools) 
found statistically significant and positive effects. Three studies 
(Riordan & Noyce, 2001, 19 later-implementing schools; Carroll, 
1998; Waite, 2001) found positive effects. And one study (Wood- 
ward & Baxter, 1997) found indeterminate effects. 



Rating of effectiveness 

The WWC rates interventions as positive, potentially positive, 
mixed, no discernible effects, potentially negative, or negative. 
The rating of effectiveness takes into account four factors: the 
quality of the research design, the statistical significance of the 
findings (as calculated by the WWC), the size of the differences 
between participants in the intervention condition and the com- 
parison condition, and the consistency of the findings across 
studies (see the WWC Intervention Rating Scheme) . The WWC 
found Everyday Mathematics to have potentially positive effects 
on math achievement. 



Improvement index 

For the math achievement outcomes, the WWC computed an 
improvement index based on the effect size (see the Technical 
Details of WWC-Conducted Computations) . The improvement 
index represents the difference between the percentile rank of the 
average student in the intervention condition versus the percentile 
rank of the average student in the comparison condition. Unlike the 
rating of effectiveness, the improvement index is entirely based on 
the size of the effect, regardless of the statistical significance of the 
effect, the study design, or the analysis. The improvement index 



Met WWC evidence standards with reservations 

Carroll, W. M. (1998). Geometric knowledge of middle school 
students in a reform-based mathematics curriculum. School 
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Additional source: 

Carroll, W. M., & Isaacs, A. (2003). Achievement of students 
using the University of Chicago School Mathematics Proj- 
ect’s Everyday Mathematics. In S. L. Senk & D. R. Thomp- 
son (Eds.), Standards-based school mathematics curricu- 
lum: Where are they? What do students learn? (pp. 79-1 08). 
Mahwah, NJ: Lawrence Erlbaum Associates, Inc. (Study: 
Geometric knowledge of fifth- and sixth-grade students.) 



can take on values between -50 and +50, with positive numbers 
denoting favorable results. The average improvement index for 
math achievement is +6, with a range of -7 to +14. 

Summary 

The WWC reviewed 61 studies on Everyday Mathematics. Four 
studies met WWC evidence standards with reservations. These 
four studies found potentially positive effects on math achieve- 
ment. The remaining studies did not meet WWC evidence 
standards. 
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standards-based mathematics curricula on student achieve- 
ment in Massachusetts. Journal for Research in Mathematics 
Education, 32(4), 368-398. 

Waite, R. D. (2000). A study of the effects of Everyday Mathemat- 
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Appendix A1.1 


Study characteristics: Carroii, 1998 (quasi-experimentai design) 


Characteristic 


Description 


Study citation 


Carroll, W. M. (1998). Geometric knowledge of middle school students in a reform-based mathematics curriculum. School Science and Mathematics, 98(4), 188-197. 


Participants 


The participants in this study were fifth graders. The study also included sixth graders, but that grade level is not within the scope of this review. Four classes of fifth graders 
from four districts that had been using Everyday Mathematics since kindergarten were selected as the intervention group, and four classes of fifth graders from similar districts 
that had been using basal mathematics texts were selected as the comparison group. All classes included students of mixed ability. Only students who took both the pretest 
and posttest were included in the analyses. The final sample consisted of 76 students in the intervention group and 91 students in the comparison group. 


Setting 


The study author indicates that the participating school districts ranged from urban to rural to suburban and included students from a wide range of social and ethnic 
backgrounds. 


Intervention 


All students that participated had been using the Everyday Mathematics cumculum since kindergarten, so the districts had been implementing Everyday Mathematics tor at 
least five years. 


Comparison 


The author describes the comparison group as students that had used more traditional basal mathematics texts at all previous grade levels. 


Primary outcomes 
and measurement 


Researcher-developed assessment of geometric knowledge consisting of 21 questions based on the van ffiele model of five levels of geometric understanding. (See Appendix 
A2 for more detailed descriptions of outcome measures.) 


Teacher training 


Teachers were provided with instructions for administering the test. No teacher training in the use of the curriculum was reported. 
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Appendix A1.2 Study characteristics: Riordan & Noyce, 2001 (quasi-experimentai design) 



Characteristic 


Description 


Study citation 


Riordan, J., & Noyce, P. (2001). The impact of two standards-based mathematics curricula on student achievement in Massachusetts. Journal for Research in Mathematics 
Education, 32(4), 368-398. 


Participants 


The participants in this study were fourth-graders. A total of 67 schools were identified as using Everyday Mathematics. Seventy-eight comparison schools were matched on 
baseline mean school performance on the previous statewide mathematics test, percentage of students receiving free or reduced lunch, ethnicity, and percentage of students 
who had limited English language proficiency and required special education services. The final sample consisted of 3,781 students in the intervention group and 5,012 stu- 
dents in the comparison group. 


Setting 


All schools were located in Massachusetts. Overall, schools in this study had a higher percentage of white students (around 90%) and a lower percentage of students eligible 
for free or reduced lunch (around 10%) when compared with the state average. Also, intervention and comparison schools had performed above the state mean on statewide 
achievement tests. 


Intervention 


The 67 schools in the intervention group had implemented Everyday Mathematics tor at least two years by 1999. Forty-eight schools in the intervention group had imple- 
mented Everyday Mathematics tor tour or more years (early implementers) and 19 schools had implemented the curriculum for two or three years (later implementers). 


Comparison 


The 78 matched comparison schools used 15 different textbook programs that, in aggregate, represented the instructional norm in Massachusetts. The most commonly used 
programs were published by Addison-Wesley, Houghton-Mifflin, and Scott Foresman. 


Primary outcomes 
and measurement 


Massachusetts Comprehensive Assessment System, a criterion-referenced state test that includes both multiple-choice and open-response questions. (See Appendix A2 for 
more detailed descriptions of outcome measures.) 


Teacher training 


None reported. 
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Appendix A1.3 Study characteristics: Waite, 2000 (quasi-experimentai design) 



Characteristic 


Description 


Study citation 


Waite, R. (2000). A study of the effects ot Everyday Mathematics on student achievement of third-, fourth-, and fitth- grade students in a iarge North Texas Urban School Dis- 
trict. Unpublished doctoral dissertation, University of North Texas, Denton. 


Participants 


The participants were third-, fourth-, and tifth-grade students. Six schools that were in their first year of implementing Everyday Mathematics mlmteered to participate in this 
study, and a comparison group of 12 schools in the same school district were selected and matched on previous mathematics scores, socioeconomic status, and ethnicity. 
The final sample consisted ot 732 students in the intervention group and 2,704 students in the comparison group. 


Setting 


All the schools in this study were located in a large urban school district in north Texas. 


Intervention 


The intervention group consisted of six schools that were part ot a pilot program and volunteered to participate in this study. The intervention schools were in their first year of 
implementing Everyday Mathematics in the 1998-1999 school year. 


Comparison 


Based on a profile of the intervention group, a comparison group of 12 schools in the same district that were similar in socioeconomic status, grade level, ethnic diversity, and 
previous year’s Iowa Test of Basic Skills mathematics score were selected. The comparison group used a more traditional mathematics curriculum approved by the school 
district. 


Primary outcomes 
and measurement 


1999 Texas Assessment ot Academic Skills mathematics scores. (See Appendix A2 tor more detailed descriptions of outcome measures.) 


Teacher training 


Teachers in the intervention schools received 40 hours of training tor the use of the Everyday Mathematics curriculum and also received the “Teacher’s Resource Package.” 
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Appendix A1.4 Study characteristics: Woodward & Baxter, 1997 (quasi-experimentai design) 



Characteristic 


Description 


Study citation 


Woodward, J., & Baxter, J. (1997). The effects of an innovative approach to mathematics on academicaliy low achieving students in inciusive settings. Exceptional Children, 
63(3), 373-388. 


Participants 


The participants in this study were third graders. Five classes of third graders in two sohools that had been using Everyday Mathematics were selected as the intervention 
group, and four classes of third graders in one similar school, matched on student demographies and geographical location, were seleeted as the oomparison group. All 
classes included students of mixed ability. The final sample consisted of 104 students in the intervention group and 101 students in the comparison group. 


Setting 


The three schools were located in the Pacific Northwest of the United States. They were all middle-class, suburban elementary schools and had very low percentages of stu- 
dents on free or reduced lunch. 


Intervention 


The intervention group consisted of five classes in two schools that were using Everyday Mathematics. They were in the third year of implementing the Everyday Mathematics 
curriculum. The intervention group consisted of 16 low-ability students, 27 average-ability students, and 61 high-ability students. 


Comparison 


The comparison group was selected from one school that used Heath Mathematics as their core curriculum, a more traditional approach focusing on computational skills. The 
comparison group consisted of 22 low-ability students, 42 average-ability students, and 37 high-ability students. 


Primary outcomes 
and measurement 


1994 Iowa Test of Basic Skills.^ (See Appendix A2 for more detailed descriptions of outcome measures.) 


Teacher training 


None reported 



1 . The study also reported outcomes on an Informal Math Assessment that assessed problem solving, not overall math achievement. Since this measure was administered to a small subsample of students and was scored subjectively 
according to a 5-polnt rubric, It did not meet WWC standards and, therefore, was not Included In this report. 
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Appendix A2 Outcome measures in the math achievement domain 



Outcome measure 


Description 


Iowa Test of Basic Skills (ITBS) 


Woodward & Baxter (1997) used one standardized measure of math achievement study. The third (Form G) of the iowa Test of Basic Skills (ITBS) was used as both a pre- 
test and posttest. This norm-referenced test has well documented reliability and validity. 


Massachusetts Comprehensive 
Assessment System (MCAS) 


As cited in Riordan & Noyce (2001), the Massachusetts Comprehensive Assessment System is administered annually and covers four strands of mathematics: number 
sense; patterns, relations, and functions; geometry and measurement; and statistics and probability. Each strand contributes at least 20% of total points and is tested 
with open-response, short-answer, and multiple-choice items. Raw scores are converted from scaled scores that range from 200-280. Reliability is estimated at 0.87 for 
grade 4. 


Researcher-developed 
assessment of geometric 
knowledge 


As cited in Carroll (1998), the van Hiele model for geometric understanding was used as a framework for constructing the pretest and posttest assessments. The pretest 
and posttest consisted of 21 questions, seven from each of the first three van Hiele levels of geometric reasoning. The authors indicated that the pretest was piloted on a 
smaller group of students the previous year and that it was reviewed by three mathematics researchers outside of the project. This outcome measure was determined to 
have face validity. 


1999 Texas Assessment 
of Academic Skills 


As cited in Waite (2000), the 1999 Texas Assessment of Academic Skills was a criterion-referenced assessment, developed by the Texas Education Agency (TEA) from the 
state-mandated curriculum to assess higher order thinking and problem-solving skills across all public schools in Texas. TEA reports an internal consistency reliability range 
of 0.88 to 0.92 for the assessment. Only the mathematics score from this assessment was used in this study. 
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Appendix A3 Summary of study findings inciuded in the rating for the math achievement domain' 









Author’s findings from the study 














Mean outcome 
(standard deviation^) 




WWC calculations 




Outcome measure 


Study 

sample 


Sample size 
(students/ 
schools) 


Everyday 

Mathematics Comparison 

group group 

(column 1) (column 2) 


Mean difference^ 
(column 1- 
column 2) 


Statistical 
significance^ 
Effect size^ (at a = 0.05) 


Improvement 

index^ 







Carroll, 1998 (quasi-experimental design) 










A 21 -item researcher developed Fifth graders in 

geometry test four schoois 


167/8 


11.9^ 

(5.3) 


10.2 

(4.0) 


1.70 


0.37 


ns 


-Hi 4 


Average® for math achievement (Carroll, 1998) 










0.37 


ns 


-Hi 4 






Riordan & Noyce, 2001 (quasi-experimental design) 








MCAS mathematics test 1999 Grade 4 (early 

implementer 

schools) 


6,009/99 


248,27 

(nr) 


243.11 

(nr) 


5.16 


na® 


Statistically 

significant 


na® 


Average® for math achievement (Riordan & Noyce, 2001, early implementers) 






na® 


Statistically 

significant 


na® 


MCAS mathematics test 1 999 Grade 4 (later 

implementer 

schools) 


2,784/46 


241,57 

(nr) 


238.59 

(nr) 


2,98 


na® 


ns 


na® 


Average® for math achievement (Riordan & Noyce, 2001, later implementers) 






na® 


ns 


na® 






Waite, 2000 (quasi-experimental design) 










Texas Assessment ot Academic Grades 3, 4, and 5 
Skills mathematics test 


3,346/18 


78.82 

(11.5) 


74.93 

(14.8) 


3,89 


0.27 


ns 


-Hll 


Average® for math achievement (Waite, 2000) 










0.27 


ns 


-Hll 



(continued) 
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Appendix A3 Summary of study findings inciuded in the rating for the math achievement domain^ (continued) 









Author’s findings from the study 














Mean outcome 
(standard deviation^) 




WWC calculations 




Outcome measure 


Study 

sample 


Sample size 
(students/ 
schools) 


Everyday 

Mathematics Comparison 

group group 

(column 1) (column 2) 


Mean difference^ 
(column 1- 
column 2) 


Statistical 
significance^ 
Effect size'* (at a = 0.05) 


Improvement 

index^ 



Woodward & Baxter, 1997 (quasi-experimental design) 



Iowa Test of Basic Skills Grade 3 205/3 

mathematics test 


59.47^ 

(11.9) 


61.48 

(11.4) 


-2.01 


-0.17 


ns 


-7 


Average® for math achievement (Woodward & Baxter, 1997) 








-0.17 


ns 


-7 


Domain average® for math achievement across all studies 








0.16 


na 


-f6 



ns = not statistically significant 

na = not applicable 

nr = not reported 

1 . This appendix reports findings considered for the effectiveness rating and the improvement index. Subtest findings from the same studies are not included in these ratings, but are reported in Appendix A4. 

2. The standard deviation across all students in each group shows how dispersed the participants' outcomes are: a smaller standard deviation on a given measure would indicate that participants had more similar outcomes. 

3. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

4. For an explanation of the effect size calculation, please see the Technical Details of WWC-Conducted Computations . 

5. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between groups. The level of statistical significance was calculated by the WWC and corrects for cluster- 
ing within classrooms or schools and for multiple comparisons. For an explanation see the WWC Tutorial on Mismatch . See the Technical Details of WWC-Conducted Computations for the formulas the WWC used to calculate statistical 
significance. In the case of the Everyday Mathematics report, a correction for clustering was needed. 

6. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. The improvement index can take on values 
between -50 and -r50, with positive numbers denoting favorable results. 

7. The WWC reports different means than the study authors because the WWC took into account the pretest difference between the study groups. In this table, the Everyday Mathematics group mean equals the comparison group mean 
plus the mean difference. 

8. The WWC-computed average effect sizes for each study and for the domain across studies are simple averages rounded to two decimal places. The average improvement indices are calculated from the average effect sizes. 

9. Student-level standard deviations were not available for this study. School-level standard deviations for early implementers were 7.9 for the intervention group and 7.2 for the comparison group. School-level standard deviations for later 
implementers were 8.1 for the intervention group and 6.2 for the comparison group. Because the student-level effect size and improvement index could not be computed, the magnitude of the effect size was not considered for rating 
purposes. However, the statistical significance for this study is comparable to other studies and is included in the intervention rating. For further details, please see Technical Details of WWC-Conducted Computations . 
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Appendix A4 Summary of subtest findings in the math achievement domain^ 









Author’s findings from the study 














Mean outcome 
(standard deviation^) 




WWC calculations 




Outcome measure 


Study 

sample 


Sample size 
(students/ 
schools) 


Everyday 
Mathematics 
group 
(column 1) 


Comparison 
group 
(column 2) 


Mean difference^ 
(column 1- 
column 2) 


Statistical 
significance^ 
Effect size'' (at a = 0.05) 


Improvement 

index^ 



Waite, 2000 (quasi-experimental design) 



TAAS math: concepts 


Grades 3, 4, and 5 


3,346/18 


17.51 

(2.6) 


16.75 

(3.1) 


0.76 


0,25 


ns 


-FlO 


TAAS math: operations 


Grades 3, 4, and 5 


3,346/18 


13.08 

(2.9) 


12.2 

(3.5) 


0.88 


0.26 


ns 


-FlO 


TAAS math: problem solving 


Grades 3, 4, and 5 


3,346/18 


9.73 8.63 1.10 

(3,6) (3.6) 

Woodward & Baxter, 1997 (quasi-experimental design) 


0.31 


ns 


-f12 


ITBS math: computations 


Grade 3 


205/3 


24.10^ 

(4.7) 


27.02 

(4.8) 


-2.92 


-0.61 


ns 


-23 


ITBS math: concepts 


Grade 3 


205/3 


20.59^ 

(4.5) 


18,9 

(4.4) 


1.69 


0.38 


ns 


-f15 


ITBS math: problem solving 


Grade 3 


205/3 


14.78^ 

(4.7) 


15,55 

(4.2) 


-0,77 


-0.17 


ns 


-7 



ns = not statistically significant 



1 . This appendix presents subtest findings from two measures of math achievement. It was determined that the subtests from these mathematics measures met WWC criterion for reliability or validity. The intervention rating was based on 
total test scores, which are presented in Appendix A3. 

2. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants had more similar outcomes. 

3. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

4. For an explanation of the effect size calculation, please see the Technical Details of WWC-Conducted Computations . 

5. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. The level of statistical significance was calculated by the WWC and corrects for cluster- 
ing within classrooms or schools. For an explanation see the WWC Tutorial on Mismatch . See the Technical Details of WWC-Conducted Computations for the formulas the WWC used to calculate statistical significance. In the case of the 
Everyday Mathematics report, a correction for clustering was needed. 

6. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. The improvement index can take on values 
between -50 and -i-50, with positive numbers denoting favorable results. 

7. The WWC reports different means than the study authors because the WWC took into account the pretest difference between the study groups. In this table, the Everyday Mathematics group mean equals the comparison group mean 
plus the mean difference. 
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Appendix A5 Rating for the math achievement domain 



The WWC rates an intervention’s effects for a given outcome domain as positive, potentially positive, mixed, no discernible effects, potentially negative, or negativeJ 
For the outcome domain of math achievement, the WWC rated Everyday Mathematics as having potentially positive effects. It did not meet the criteria for positive 
effects, because no Everyday Mathematics studies met WWC evidence standards for a strong design. The remaining ratings (mixed effects, no discernible effects, po- 
tentially negative effects, and negative effects) were not considered, because Everyday Mathematics was assigned the highest applicable rating. 



I Rating received 

Potentially positive effects: Evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: At least one study showing a statistically significant or substantively important positive effect, thus qualifying as a positive effect. 

Met. Two studies showed substantively important positive effects. A third study showed a statistically significant positive effect. 

• Criterion 2: No studies showing a statistically significant or substantively important negative effect. Fewer or the same number of studies showing indeterminate 
effects than showing statistically significant or substantively important positive effects. 

Met. The WWC analysis found no statistically or substantively important negative effect. One study showed an indeterminate effect and three stud- 
ies showed substantively important positive effects. 

Other ratings considered 

Positive effects: Strong evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: Two or more studies showing statistically significant positive effects, at least one of which met WWC evidence standards for a strong design. 

Not met. The WWC analysis found no studies that met WWC evidence standards for a strong design. 

• Criterion 2: No studies showing statistically significant or substantively important negative effects. 

Met. The WWC analysis found no significantly significant or substantively important negative effects. 



1 . For rating purposes, the WWC considers the statistical significance of individual outcomes and the domain level effect. The WWC also considers the size of the domain level effect for ratings of 
potentially positive effects. See the WWC Intervention Rating Scheme for a complete description. 
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Appendix A6 Extent of evidence by domain 



Outcome domain 


Number of studies 


Schools 


Sample size 


Students 


Extent of evidence^ 


Math achievement 


4 


174 




12,511 


Moderate to large 



1 . 



A rating of “moderate to large” requires at least two studies and two schools across studies in one domain and a total sample size across studies of at least 350 students or 14 classrooms. Oth- 
erwise, the rating is “small.” 
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